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Abstract —This paper reports a new reading for wavelets, 
which is based on the classical ’De Broglie’ principle. The wave- 
particle dnality principle is adapted to wavelets. Every continuous 
basic wavelet is associated with a proper probability density, 
allowing defining the Shannon entropy of a wavelet. Further 
entropy definitions are considered, snch as Jumarie or Renyi 
entropy of wavelets. We proved that any wavelet of the same 
family {'ipa,b{t)}aj^o has the same Shannon entropy of its mother 
wavelet. Finally, the Shannon entropy for a few standard wavelet 
families is determined. Q 

Index Terms —Continuons wavelet, De Broglie duality. Shan¬ 
non entropy of wavelets. 


I. PRELIMINARIES AND BACKGROUND 

Little has been made for analogue signals in the information 
theory scope as compared to the amazing coverage nowadays 
available for digital signals m. This paper is precisely 
focused on this rather unexplored field, taking advantage of 
a fresh and powerful tool; the wavelet analysis lEl, Q - that 
evolved into a specialised branch of the modern-day signal 
processing. 90’s witnessed the emergence of wavelets, which 
rapidly reached in practice, thanks to their natural feature of 
concentrating energy in a few transform coefficients. This 
paper intends to introduce a new insight into wavelets, which 
is based on the conventional De Broglie duality principle and 
the statistical interpretation of the wave-function formulated 
by Max Born a. Two concepts of information (logon and 
Shannon information) are considered a, a, as well as their 
relation with entropy. Entropy (Greek: en + frope=inH-turning) 
is one of the most fundamental concepts of Science. Since the 
notion of entropy appeared, it has always been surrounded 
by a halo of inscrutability. The well-known German chemist 
W. Ostwald put it in this way: ’’Energy is the queen of the 
world, and entropy is her shadow!” It was also told that when 
Von Neumman suggested that Shannon use the word entropy, 
he added, ”it will give you a great edge in debates because 
nobody really knows what entropy is anyway” Q. Quite 
often people hear about entropy the first time when the most 
tantalising problems such as the origin of the life or the future 
of the universe is discussed. Schrodinger has mentioned 
that living organisms feed on negative entropy, i.e., they drive 
in the direction of increasing organisation. The proposal of 
this paper is mainly to build a bridge between two areas 
of applied mathematics: the analysis-decomposition (with 
wavelets) and the Information Theory, from a perspective not 
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much explored so as to awaken interest in new advances. It 
should be clarified that techniques and results derived in this 
article are naive. 

To begin with, a first question is raised: ”Is it possible 
to associate an entropy measure with a wavelet”? Jumarie 
0 introduced entropy associated with a given continuous 
differentiable function / : U C M —>• M as (K denotes the real 
set) 




In 


lf(x)lloglf(x))dx 

f^lf'(x)ldx 


( 1 ) 


As a first attempt, the entropy of a continuous differentiable 
wavelet '0 : K —>■ K can be defined by 






( 2 ) 


The seminal Max Born footnote for interpreting the solution 
of Schrodinger equation in quantum mechanics is applied here 
in the wavelet framework. As a consequence, it is suggested 
that wavelets can behave as some kind of little particle 
(corpuscle of a true random nature). Bearing in mind that 
the square of the wave-function is a probability density, we 
propose in a parallel way to associate a probability density 
function (PDE) ptiip) ■= 0^(0 with every basic continuous 
wavelet '0(f). Given that Eourier transform is an isometric 
transform, we can go further anchored in the Parseval identity 
and propose to associate 0 with an additional density function 
expressed by p^(0) := ^|'k(rt;)p, where T'(w) is the Eourier 
transform of 0(f). The fundamental challenge is to determine 
the behaviour of a corpuscle when its freedom of motion 
is limited by the action of external forces: each wavelet 
describes a specific situation. It can be therefore stated that; 
’’wavelets are to corpuscle as wave-functions are to particles.” 
After unveiling such probabilistic properties associated with 
wavelets, it is intuitive to set up another concept; the Shannon 
entropy associated with a wavelet as a measure of the disorder 
of a signal. The entropy of a random variable can be defined in 
the discrete case as well as in the continuous case Go), im. 
In the later case, the so-called Shannon differential entropy of 
a random variable X with probability density p{x) is defined 
by 


HiX) := - 


P + OO 


p{x).logp{x)dx 


(3) 


The information unit depends on the base of the logarithm. 
Eor the sake of convenience, shannon (binary unit) is adopted 
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through this paper for the information unity. 

According to the above vindication, the entropy of a wavelet 
can be measured by: 

Definition 1: (Shannon entropy of a wavelet). The time 
entropy, of a continuous wavelet '0(.) is dehned by 

/ +00 

'ijP'{t).log2'ip'^{t)dt (4) 

-OO 

In an parallel way, the frequency entropy, of a 

continuous wavelet ^/>(.) is dehned by 

^+oo 1 1 

—|T'(w)p./o52;^|^(w)Prfu; (5) 

The entropy gives information on the spreading of the wa¬ 
velet, i.e., it furnishes a ’’localising measure”of the corpuscle 
in a particular domain (time or frequency). The probability 
distribution function associated with the density pt (ip) is given 
by P{t) = The time Shannon entropy of a 

wavelet is, therefore, exactly the Jumarie entropy of the PDF 
related to the density ip'^(t), i.e., = iF(P(.),K). For 

completeness, other ”non-shannonian” measures such as the 
Renyi entropy of order s > 0 could promptly be dehned for 
wavelets El: 

:= (^J -ip^‘'it')dt''^ ( 6 ) 

which hold 

lim Htifils) = Htifij) (7) 

s —>-1 

Indeed, while Gabor functions can be used to derive similar 
results, it is worth noting that standard are also wavelets. 
The harmonic oscillator equation solutions m have these 
properties. In fact, Hermite polynomials of degree n, 
modulating a Gaussian pulse, yield either a wavelet or a scale 
function (respectively, n odd, n even). Now, even further 
class of functions such as ’wave functions’ of the Schrodinger 
equation could also be considered, it must be remembered 
that they can also be interpreted as wavelets. 

Conducting a careful literature search, attempts to connect 
wavelets and entropy were found. In 1999, Quian Quiroga, 
Rosso and Basar have successfully applied a disorder measure 
in neuroscience na. Here, the total energy Etot of the signal 
in each time window is calculated as the sum of energies of all 
resolution levels. The relative wavelet energy Pj is computed 
as the ratio between the energy of each level, Ej, and total 
energy of the signal, Etot, in the respective time window. The 
wavelet entropy, Swt, was then dehned by 

SwT ■= — E PjlnPj (8) 

j 

The main focus of this tool had specihcally been on the 
electroencephalogram analysis lfT3l . lfT4l . ifTSll . ifThl . Thereaf¬ 
ter, this concept was applied to astronomy with the aim of 

^Although the attempt to replace the term bit by the term shannon unit, 
used by the International Standard Organization (ISO) in 1975, retrospectively 
had not been very successful. 


investigating the solar activity ini. Despite the fact that Swt 
had been referred to as the wavelet entropy up to now, it should 
not be named so. Actually, Swt depends on the analysed 
signal and it is not a solely feature of the ip wavelet itself. 
The term ’’wavelet entropy”is thereby somewhat inappropriate, 
and it should be better called as ’’the entropy of a wavelet 
decomposition of a signal.” 

II. On The Shannon Entropy of Continuous 
Wavelets 

The effect of scaling or shifting a mother wavelet on the 
time and frequency entropy is initially examined. 

Proposition 1: : Given a continuous mother wavelet '0(.) 

with time entropy Ht{'ip) and frequency entropy Hf{'tjj), the 

entropy of a daughter wavelet ipa.bit) := a 0 

V 1^1 

can be computed by Ht{ipa,b) = Ht{'ip) + log^fi], and 

= Hfi'fi) - log2\a\. 

Proof: . The hrst part follows from substituting ipob ~ 
in Dehnition 1, and evoking that both 'tp(.) and 
^a,b{-) have normalised energy. The second part is derived 
using |T'a,b(w;)P = |a|.|T'(ar(;)p. ■ 

The highest time entropy among all supportly compacted 
wavelets is achieved by the Haar wavelet. This is in agreement 
with the fact that maximum entropy of a discrete random 
variable is achieved by a uniform distribution as it can be 
seen by the following proposition: 

Proposition 2: : The time entropy of any wavelet of com¬ 
pact support is bounded by Htip < log 2 length{Supp{ip)), and 
the bound is only met by the Haar wavelet. 

Proof: . Let L := length{Supp{ilj)) denote the length of 
the support of the wavelet and A := Ht{ip) — log 2 L. Clearly 

A := /" 'ip‘^{t)log2 (9) 

Jsupptp Pip (t) 

Then 

^0 ( 10 ) 

Iti 2 JSupp('tp) \P^ (g) / 

The upper bound is only achieved by a Haar scaled version 

'4’ab°''"(t), where a = length{Supp{ip))/2. 

■ 

Corollary 1: : The time Shannon entropy of dBN wavelet 
is bounded by Ht{dBN) ^ log2(2N — 1). 

This result can equally be translated into the frequency 
domain, deriving, for instance. 

Corollary 2: : The frequency Shannon entropy of the deO 
wavelet m is upper bounded by Hf{deO) ^ log 2 {TT + 3Tra). 

A pertinent comment should now be pointed out. According 
to the deterministic approach, in the cases where the wavelet 
waveform is fully known, so is its spectrum. One could argue 
that there is no information in the frequency domain. Now, this 
reasoning is fallacious. If the wavelet spectrum is perfectly 
determined, no information is provided in the time domain! 
Instead of this, it seems to be some amount of information in 
both domains matching with the Gabor uncertainty principle. 
In the probabilistic interpretation offered in this paper, even 
knowing and it do exists some nonzero uncertainty 
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in both time and frequency domain. The global entropy would 
be partially due to the (inherent) time-uncertainty and partially 
due to the (inherent) frequency-uncertainty. The entropy is 
only added when dealing with independent variables. We as¬ 
sume that the mutual information between time and frequency 
domain is zero, i.e., /(?/;, T*) = — = 0. 

An interesting argument consists of defining the global 
entropy of a wavelet as the sum of the entropy in both domains. 

Formally, 

Definition 2: (Global entropy of a continuous wavelet). The 
global entropy of a wavelet is defined by 

+ ( 11 ) 

A direct property follows from such a definition: every 
daughter wavelet has the same global entropy of the mother 
wavelet, some sort of conservation principle. It follows then 

Corollary 3: : The global entropy is preserved within the 
same wavelet family {'0a,b(i)}a^o feeR 
a unique entropy value associate to a wavelet basis. 

Thermodynamic concepts of entropy are always related 
to the temperature. Particularly, common units for entropy 
are Joule.and cal.K“^. Having defined the entropy of 
wavelets, another concept of interest could be the ’’temperature 
of a wavelet”. This modus operandi suggests computing the 
temperature as the ratio between energy and entropy of the 
wavelet, i.e., := E^/H^, where := is 

the energy of the wavelet. For instance, the temperature of the 
complex Morlet wavelet is TcMor ~ 0.3232°, that is hotter 
than the mexican hat wavelet {TmcxH ~ 0.2700°), and Haar 
wavelet is even colder, Tnaar ~ 0.2006°. 

Tabela I 

ANALYTICAL EXPRESSIONS OF SOME CONTINUOUS 

WAVELETS: MORLET, MEXICAN HAT, GAUSS 1, SHANNON, 
HAAR, AND DE OLIVEIRA WAVELETS. 


Complex Morlet 
(CMor) 
Sombrero 
(mexh) 

C Shannon 
(Sine) 

Haar 

(Haar) 
Morlet 
(Mor) 
Gaussian 1 
(gauss 1) 
Shannon 
(Sha) 

de Oliveira 
(CdeO) 




2 

V’S 




1 ) 




sinc{t)e-i'^'^\ sinc(t) := 



if 0<t<l 
if - 1 <t<0 
otherwise. 


V2cos{6t). ^ ^ 




smc(|)cos(^) 

5Re q) = s(t — 0.5, q) 
a) = s{t — 0.5, a) 

s and 's defined according to na. 


Since the two densities and are related 

via the transform pair the time-frequency 

relationship is disclosed on the ”partition”of the total uncer¬ 
tainty. The concept of isoresolution (introduced lfT9l ) can now 


be bringing into play. Specifically, ’’Are there wavelets that 
achieve the same entropy in both domain”? A class of signals 
that hold special and nice-looking properties are the invariant 
signals under the Fourier transform. Wavelets that belong 
to this specific class achieve matching time and frequency 
entropy, upholding the earlier idea of isoresolution. Evoking 
the following proposition can easily prove this El: 

Proposition 3: : Possible eigenvalues of the Fourier trans¬ 
form operator are one of the four roots of the unit (±1, ±j) 
times a/^. 

Proof: : see El- ■ 

Proposition 4: : Isoresolution wavelets hold 

( 12 ) 

Proof: : Fourier eingenfunction wavelets possess 
|'I'(w)| = and the proof follows. ■ 

In order to gain insight into this new thought on wavelets, 
a number of standard wavelets were selected (Table I) and we 
plotted both time and frequency density functions associated 
with such wavelets (Figure 1). It is valuable remarking that 
CMor and gauss 1 are transform-invariant wavelets; hence 
achieve isoresolution El, yielding a balanced time and 
frequency entropy (see Proposition 4). Furthermore, Gabor 
inequality established a lower bound on the product between 
the variances associated with these two densities. There might 
thus exist some uncertainty principle between the time and the 
frequency entropy, i.e., a lower bound on Ht{ip).Hf{'ilj). 

Proposition 5: : The uncertainty principle for Shannon en¬ 
tropy of a wavelet family is given by Ht{ij}).Hf{ip) ^ H^/A. 

Proof: The minimum of the product 

Htiyp). — Ht{f})) is achieved when Htifii) = H^/2 so 
that Htffi) = establishing thereby the bound. ■ 

The entropy of the wavelets presented in Table I was 
subsequently determined (Table II), displaying how much the 
Morlet wavelet is endowed with wavelet analysis. The closed 
expression for the entropy of the (complex) Morlet wavelet is 

Hti'fcMor) = Hf{'ficMor) = ( 052 ( 1 /^), ( 13 ) 

SO that HcMor = (o<?2(7re). The time entropy of the 
standard Haar wavelet is equal to unity as predicted by 
Proposition 2. Alike, the frequency entropy of the complex 
Shannon wavelet is bounded by log 2 {'r) 

The frequency entropy of de Oliveira wavelet 
is bounded by Hf{deO) < log 2 {Tt -I- 37ra), i.e., 
2.030008 and 2.329568 for q ;= 0.1 and 0.2, respectively 
(referenced at the URL of the author’s Website 
http://www2.ee.ufpe.br/codecAVEBLET.html) 

We speculate that the minimum entropy H is achieved by 
a double Gaussian distribution (time and frequency domain), 
which is entirely in agreement with the long-standing concept 
of logon by Gabor Q. In fact, a couple of wavelets are 
particularly signiheant: Morlet wavelet and Haar wavelet. 
Inquiringly, these were exactly pioneer wavelets! 

A good number of orthogonal wavelets cannot be described 
by analytical expressions, but fairly via hlter coefficients [20] 
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Time density probability Frequency density probability 

function y /)function /?/( y/) 








Poicotd.ai) 

PcdeOt(t.lX2) 


(■•i) 



' alphas. 1 
' alptiaH)— 
alpka*l/3 



(a) 


(b) 


(c) 


(d) 


(e) 


(0 


(g) 


(h^ 


Tabela II 

ENTROPY OF SOME WAVELETS: TIME ENTROPY, FREQUENCY 
ENTROPY AND AREA OF A WAVELET CELL IN THE lOINT T-F 
PLANE AND GLOBAL ENTROPY. WAVELETS: MORLET, 
SOMBRERO, SHANNON, GAUSS 1, DE OLIVEIRA AND HAAR. 


CMor 

1.547096 

1.547096 

2.393506 

3.094191 

Mor 

1.104425 

2.547095 

2.813075 

3.651520 

mexh 

1.715098 

1.988567 

3.410587 

3.703665 

Sine 

2.221052 

1.651383 

3.667807 

3.872435 

gauss 1 

1.937147 

1.937147 

3.752538 

3.874293 

Sha 

1.768634 

2.651665 

4.689824 

4.420299 

CdeO 

0=0.1 

3.045824 

1.818698 

5.539434 

4.864522 

0=0.2 

2.915276 

1.985887 

5.789408 

4.901163 

Haar 

1.000000 

3.985653 

3.985653 

4.985653 


using the so-called two-scale relationship of a multiresolution 
analysis EHi 1^ : Two-scale relation of the scaling function: 

+00 

= V2 hicj){2t - 1) (14) 

1 — — 00 

Two-scale relation of the wavelet: 

+00 

i;{t) = V2 ^ gi(t>{2t-l) (15) 

1 — — 00 


Let Z denote the set of integers. The low-pass H{.) filter 
of the MRA: H{ui) := H{0) = \/2 and 

H{Tr) = 0. The high-pass G(.) filter of the MRA: 

G{uj) := G(0) = 0 and G(7r) = \/2. 

For the sake of simplicity, filter coefficients will encompass 
the term ^/2, i.e., hk -^hk and gk ^ these cases, 



= ^hl 

keL 


= E^ = l 


(16) 



= ^gl= E^ = l. 

keL 


(17) 


The (discrete) probability density of ip is described by 
the probabilities MRA wavelet entropy can be 

computed by 


+ 00 +00 

HmraW ■■= 9klog2{gl) = (18) 

fc—— oo k— — oo 


Tabela III 

TIME ENTROPY OF SOME ORTHOGONAL WAVELETS DEFINED 
BY MRA FILTERS. WAVELETS OF COMPACT SUPPORT: 
DAUBECHIES, SYMMLET WAVELETS WITH AT = 1,.., 4 
VANISHING MOMENTS; OTHER WAVELETS: COIFLETS W = 1, 2 
AND ELLIPTIC-CYLINDRICAL MATHIEU WAVELET WITH 
PARAMETERS u AND q . 


Figura 1. Time and frequency probability density functions associated with 
some standard wavelets. Plots for: (a) Complex Morlet wavelet; (b) Real 
Morlet wavelet; (c) Mexican hat wavelet; (d) gauss 1 wavelet, (e) Complex 
Shannon wavelet; (f) Real Shannon wavelet; (g) Haar wavelet; (h) de Oliveira 
wavelet for different roll-off parameters, 0=0.1, 0.2, and 1/3 (H. 



Daubechies 

Symmlet 

Coiflet 

Mathieu 

N 

HMRA(dBN) 

HMRA(symN) 

HMRA(coifN) 

i/; q HMRA(mth) 

1 

1.000000 

1.000000 

1.183011 

1; 5 2.097353 

2 

1.165857 

1.165857 

1.376543 

5; 5 1.739816 

3 

1.397665 

1.397665 



4 

1.447745 

1.345513 




Daubechies, Symmlets, Coiflets, or even Mathieu wavelets Let H 2 {p) '■= —pdog 2 p—{i—p)dog 2 {i—p) he the Shannon 
ED. The Shannon entropy of such wavelets can be found by binary entropy 0. The Shannon entropy of the dBl wavelet 
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(Haar), which is described by HMRA{i^dBi) = 

H{'ipHaar) = -^2(1/2) = 1 as expected. For dB2, whose filter 
coefficients are given by 


1 + ^3 3 + ^3 3-v^ 1-^3 

4^2 ’ 4^2 ’ 4^2 ’ 4V2 J ^ ^ 

the entropy is HMRA{'4’dB2) = 1.16585703. Values of the 
Shannon entropy for a few orthogonal wavelets defined by 
MRA filters are presented in the Table III. The bound derived 
for supportly compact wavelets (Proposition 2) can be checked 
without effort. We hypothesize from Eqn(18) and Table III that 
Hmra{4’) is probably the same as 


III. Concluding Remarks 
Wavelet is a body of knowledge of enormous fascination and 
far-reaching utility in signal processing, which is advancing 
at an astonishing pace. Mimicking the quantum mechanics 
approach, each of (continuous) wavelets is associated with 
two probability density functions one on the time domain, and 
another on the frequency domain. Consequently, the Shannon 
entropy and Renyi entropy of a wavelet were defined. We deri¬ 
ved some sort of entropy conservation principle, which stated 
that wavelet versions resulting from the same mother wavelet 
retain the same Shannon entropy. The logical consistency of 
the melange of claims throughout this paper provides certain 
evidence on the worthiness of our approach. The emphasis 
of this paper was on conveying the chief ideas as opposed to 
presenting a formal mathematical development or applications. 
Indeed, much was left to be investigated. Despite the fact that 
a mere trough draft of this technique had been outlined, it 
instigates certain expectation on both theoretical and practical 
information theory outcome related to wavelet analysis (e.g. 
wavelet compression can be carried out on wavelet-based 
information-theory-oriented algorithms not on the energy.) We 
foresee that our attempt to present the underlying philosophy 
of behind the wavelet information theory may help users 
navigate the ocean of wavelets. 
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